Markov chains approximation of jump–diffusion stochastic master equations
نویسندگان
چکیده
منابع مشابه
Diffusion Approximation of Stochastic Master Equations with Jumps
In the presence of quantum measurements with direct photon detection the evolution of open quantum systems is usually described by stochastic master equations with jumps. Heuristically, diffusion models can be obtained from these equations as approximation. A condition for a general diffusion approximation for jump master equations is presented. This approximation is rigorously proved by using ...
متن کاملSolutions of Backward Stochastic Differential Equations on Markov Chains
Consider a continuous time, finite state Markov chain X = {Xt, t ∈ [0, T ]}. We identify the states of this process with the unit vectors ei in R N , where N is the number of states of the chain. We consider stochastic processes defined on the filtered probability space (Ω, F , {Ft}, P), where {Ft} is the completed natural filtration generated by the σ-fields Ft = σ({Xu, u ≤ t}, F ∈ FT : P(F ) ...
متن کاملLinear stochastic approximation driven by slowly varying Markov chains
We study a linear stochastic approximation algorithm that arises in the context of reinforcement learning. The algorithm employs a decreasing step-size, and is driven by Markov noise with time-varying statistics. We show that under suitable conditions, the algorithm can track the changes in the statistics of the Markov noise, as long as these changes are slower than the rate at which the step-s...
متن کاملAdaptive Importance Sampling Technique for Markov Chains Using Stochastic Approximation
For a discrete-time finite-state Markov chain, we develop an adaptive importance sampling scheme to estimate the expected total cost before hitting a set of terminal states. This scheme updates the change of measure at every transition using constant or decreasing step-size stochastic approximation. The updates are shown to concentrate asymptotically in a neighborhood of the desired zero varian...
متن کاملApproximation of stochastic advection diffusion equations with finite difference scheme
In this paper, a high-order and conditionally stable stochastic difference scheme is proposed for the numerical solution of $rm Ithat{o}$ stochastic advection diffusion equation with one dimensional white noise process. We applied a finite difference approximation of fourth-order for discretizing space spatial derivative of this equation. The main properties of deterministic difference schemes,...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Annales de l'Institut Henri Poincaré, Probabilités et Statistiques
سال: 2010
ISSN: 0246-0203
DOI: 10.1214/09-aihp330